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ADVANCED  WAVELET  METHODS 
FOR  IMAGE  AND  SIGNAL  PROCESSING 

Principal  Investigator:  Ronald  A.  DeVore 


FINAL  TECHNICAL  REPORT 
Contract  Number:  N00014-99-1-0547 


Overview:  Research  of  the  Principal  Investigator  on  this  contract  was  directed  towards 
areas  of  mathematics  and  numerical  computation  which  have  applications  to  image/signal 
processing  and  PDEs.  The  research  can  be  broadly  classified  into  the  following  areas:  (i) 
image  processing,  (ii)  processing  Digital  Terrain  Elevation  Data  (DTED),  (iii)  information 
theory,  (iv)  analogue  to  digital  conversion,  (v)  approximation,  and  (vi)  theoretical  and  nu¬ 
merical  PDEs.  We  briefly  summarize  the  highlights  of  our  work  in  these  areas. 


Image  Processing 

We  have  concentrated  on  techniques  which  are  important  for  automated  target  recogni¬ 
tion.  The  first  step  is  usually  to  compress  and  remove  noise  from  the  image.  Later  steps 
include  feature  extraction  and  image  registration.  Some  highlights  of  our  work  are  the  fol¬ 
lowing: 

Image  Compression. 

We  continue  our  efforts  to  understand  image  compression  through  mathematical  analysis. 
The  paper  [CDDD]  introduces  a  new  concept  of  tree  approximation  and  shows  its  funda¬ 
mental  role  in  the  construction  of  modern  image  encoders.  In  particular,  we  use  these  ideas 
to  create  an  encoder  which  is  progressive,  optimal  (in  the  sense  of  Kolmogorov  entropy)  for 
classes  of  images  modelled  on  Besov  smoothness,  and  allows  burnin.  The  burnin  property, 
reported  on  in  [DJPS]  allows  the  user  to  specify  a  subregion  of  the  image  and  subsequent 
bits  in  the  bitstream  will  only  pertain  to  this  subregion.  Further  results  on  tree  approxima¬ 
tion,  namely  how  to  find  optimal  trees,  is  given  in  [BDKY].  A  paper  in  preparation  [BDP] 
shows  how  one  can  obtain  near  best  tree  approximants  of  an  unknown  function  with  0(n2) 
computations  through  querries.  This  result  is  important  in  PDE  solvers.  Our  recent  work  is 
directed  at  video  encoding  including  encoding  in  a  wireless  environment.  We  are  developing 
wavelet  flow  algorithms  to  predict  subsequent  frames  in  video  (from  an  initial  frame)  which 
is  an  attractive  substitute  for  motion  compensation  and  optic  flow  predictions. 


Noise  Suppression. 

The  space  BV  of  functions  of  bounded  variation  is  often  used  as  a  model  for  real  images  (an 
idea  of  Mumford  and  Shah).  Therefore  this  space  appears  in  important  extremal  problems 
resting  at  the  core  of  noise  reduction  in  images.  In  [CDPX],  we  make  the  remarkable 


discovery  that  wavelet  thresholding  is  a  minimizer  for  the  K-functional  between  L2  and 
BV.  Heretofore,  this  minimization  problem  was  solved  only  using  PDE  techniques  which  are 
numerically  intensive.  The  proof  that  wavelet  techniques  also  minimize  is  deep  and  depends 
on  a  new  adaptive  algorithm  for  piecewise  constant  approximation.  The  numerical  imple¬ 
mentation  of  these  results  give  visually  comparable  performance  to  PDE  based  algorithms 
with  far  less  computation. 

In  [CDKP],  we  analyze  thresholding  algorithms  used  in  statistical  estimation  and  show 
that  to  each  such  algorithm  one  can  associate  a  certain  maximal  space  which  benchmarks 
their  performance.  The  main  tool  for  obtaining  maximal  spaces  is  to  develop  an  approx¬ 
imation  theory  [CDH]  which  describes  error  rates  when  the  error  is  measured  in  Lp  (not 
necessarily  p  =  2)  while  the  thresholding  is  done  relative  to  another  Lr  norm. 


Digital  Terrain  Elevation  Data  (DTED) 


USC  has  assembled  a  team  (led  by  the  PI)  of  research  faculty,  postdoctoral,  graduate 
and  undergraduate  students  who  are  working  to  develop  multiscale  methods  for  the  rapid 
processing  of  large  data  sets  with  a  particular  emphasis  on  the  application  of  this  processing 
platform  to  DTED  maps  and  associated  imagery.  Several  algorithms  are  currently  under 
investigation  for  efficient  and  accurate  processing  of  DTED  maps  for  registration,  denoising, 
compression,  and  rendering  operations. 

Some  of  the  desired  features  of  the  algorithms  under  development  are:  (a)  high  compres¬ 
sion,  (b)  robust  error  handling,  (c)  progressive  transmission  of  the  data,  (d)  quick  rendering, 
and  (e)  burning  in  (tunneling),  and  (f)  line  of  sight  display.  Since  almost  all  graphic  hard¬ 
ware  uses  triangular  polygonal  patches  as  building  blocks  for  object  description,  we  have 
focused  our  attention  on  algorithms  utilizing  meshes  of  polygonal  elements.  Two  classes  of 
algorithms  are  being  investigated: 

•  Nonlinear  approximation  algorithms  based  on  adaptive  multiresolution  analysis, 

•  Greedy  (insertion  or  removal)  algorithms  for  mesh  construction  which  utilize  Delaunay 
triangulations. 


The  first  algorithms  include:  (a)  initial  course  adaptive  triangulation  which  allows  a 
low  resolution  good  approximation,  (b)  wavelet  decomposition  of  the  function  for  achieving 
sparse  representation  of  the  function  (surface),  (c)  conversion  to  hierarchical  B-spline  rep¬ 
resentation  and  application  of  the  nonlinear  uniform  approximation  schemes  adapted  from 
our  previous  work  on  adaptive  approximation,  (d)  compression  and  progressive  transmission 
of  the  data  using  the  hierarchical  representation. 

The  greedy  removal  algorithm  is  a  recursive  procedure  with  the  following  basis  elements: 
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by  one  of  the  least  significant  points,  (c)  mesh  updating  after  each  removal  with  Delaunay 
triangulation  algorithm.  The  greedy  insertion  algorithm  utilizes  the  same  elements  but  in  a 
reverse  order.  We  pay  special  attention  to  the  data  structures  that  enable  us  to  compress 
and  transmit  the  data  progressively. 


Although  we  have  developed  methods  for  n-term  piecewise  polynomial  approximation 
which  provide  the  best  asymptotic  rates  of  approximation,  practical  implementation  issues 
will  ultimately  determine  the  extent  to  which  these  methods  are  useful  in  applications.  We 
have  formed  an  algorithm  implementation  team  to  develop  research  software  incorporating 
both  the  nonlinear  approximation  and  greedy  methods  mentioned  earlier.  There  is  a  com¬ 
mon  modularized  framework  (OPTA)  for  possible  variations  of  the  algorithms  which  will 
provide  the  flexibility  of  designing  and  testing  proposed  hybrid  methods,  and  will  allow  us 
to  compare  our  results  with  those  of  other  researchers.  The  various  components  are  built 
upon  a  common  elemental  base  of  hierarchical  structures  naturally  suited  for  multiresolution 
analysis,  data  operations,  and  rendering  of  the  surfaces.  Specialized  data  structures  have 
been  tailored  to  take  advantage  of  particular  attributes  of  the  approximation  algorithms  un¬ 
der  investigation.  In  order  to  test  the  composite  approximation  and  rendering  schemes  under 
a  variety  of  computing  environments,  code  development  is  in  C,  using  the  GLUT  libraries 
for  windowing  and  OpenGL  language  for  graphics  rendering.  Special  consideration  has  been 
given  to  insuring  that  rendering  algorithms  take  full  advantage  of  hardward  available  on  a 
given  platform.  Additional  attention  in  the  development  is  being  paid  to  future  options  of 
distributed  and  massively  parallel  development,  since  the  algorithms  are  inherently  scalable. 

The  potential  applications  of  this  technology  include  mission  planning  and  rehearsal, 
autonomous  navigation,  rapid  registration  of  imagery  to  DTED,  post  battle  assessment, 
rapid  telecommunication,  and  efficient  touring,  querying  and  storage  of  large  data  bases. 


Analogue  to  Digital  (A/D)  Converters 


There  is  great  demand  for  efficient  analogue  to  digital  converters  in  both  the  civilian 
and  military  sectors.  State  of  the  art  methods  are  the  Sigma-Delta  converters  which  consist 
of  three  steps:  (i)  oversampling  the  signal,  (ii)  one  bit  quantization  of  the  oversampled 
values,  and  (iii)  filter  reconstruction.  Sigma-Delta  converters  work  well  but  there  was  no 
mathematical  understanding  of  why.  Daubechies  and  DeVore  [DD]  began  to  mathematically 
analyze  sigma-delta  converters  and  have  been  able  to  quantify  their  success.  They  have  also 
derived  higher  order  methods  which  theoretically  perform  better  than  existing  converters. 
These  methods  are  being  analyzed  further  for  their  practicality  and  implementation  in  silicon. 

There  is  presently  a  small  consortium  consisting  of  Daubechies,  DeVore,  and  researchers 
at  AT&T,  Lucent,  and  Hewlett  Packard,  who  are  investigating  the  performance  of  the  new 
sigma-delta  architectures.  One  of  the  main  goals  of  this  collaborative  effort  is  to  explain 
the  success  of  Sigma-Delta  modulation.  Toward  that  end,  we  have  shown  in  [DDGV]  that 
Sigma-Delta  has  the  remarkable  feature  that  it  is  self  correcting  for  quantization  error. 
This  property  is  not  inherited  by  Pulse  Code  Modulation  (PCM)  which  is  built  on  the 
Shannon  sampling.  Further  investigations  have  been  sparked  by  the  fact  that  PCM  has 
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have  polnomial  decrease.  We  have  found  in  [DDGV]  that  it  is  possible  to  use  redundancy 
to  create  encoders  which  have  exponential  decreasing  distortion  rate  while  retaining  the 
quantization  error  correction  of  Sigma-Delta,  i.e.  one  has  the  best  of  both  worlds. 


Information  Theory 


In  [DVDD],  we  have  given  a  survey  and  state  of  the  field  accounting  of  the  role  of 
Harmonic  Analysis  in  information  theory,  especially  data  compression.  The  main  point  of 
this  article  is  that  advances  in  information  theory  parallel  advances  in  harmonic  analysis. 
Also,  harmonic  analysis  gives  the  theoretical  underpinnings  which  explain  the  connections 
between  the  Shannon  (stochastic)  theory  and  the  Kolmogorov  (deterministic)  theory. 

We  are  currently  developing  an  information  theory  description  applicable  in  other  settings 
such  as  DTED.  The  elements  of  this  theory  are  models  for  DTED  data  sets,  metrics  to 
measure  the  distortion  commensurate  with  applications  (Hausdorff  metric  and  line  of  sight 
metrics)  and  encoders  which  perform  at  optimal  bit  rate.  As  a  sample  theorem  we  mention 
that  we  have  shown  that  the  elements  in  the  space  BV  of  functions  of  bounded  variation 
can  be  encoded  in  the  Hausdorff  metric  to  distortion  0(1 /n )  using  n  bits  whereas  this  set 
is  not  even  compact  in  the  stronger  L0 0  metric  (and  hence  cannot  be  encoded  at  all  in  that 
metric). 


Approximation  Theory 

We  continue  our  work  in  approximation  theory  which  we  feel  provides  a  theoretical  un¬ 
derpinning  for  many  application  areas  such  as  image  processing  and  PDE  solvers.  We  have 
introduced  tree  approximation  in  [CDDD]  since  it  models  both  image  encoders  as  well  as 
adaptive  PDE  solvers.  The  work  in  [CDDD]  provides  the  fundamental  rate  of  approxima¬ 
tion  bounds  for  this  form  of  nonlinear  approximation.  In  [BDKY],  we  have  characterized 
precisely  the  functions  which  have  a  prescribed  rate  of  tree  approximation  through  certain 
maximal  operators.  In  [BDP],  we  give  fast  numerical  methods  for  the  implementation  of 
tree  approximation.  It  is  shown  that  it  is  possible  to  find  near  best  tree  approximants  for  an 
unknown  function  /  using  only  0(n2)  querries  of  its  wavelet  coefficients.  The  importance  of 
this  paper  lies  in  PDE  solvers  where  the  solution  is  not  known  and  so  it  is  not  clear  which 
wavelet  coefficients  to  evaluate  in  an  adaptive  numerical  scheme. 

We  have  also  done  fundamental  work  on  approximation  using  a  library  of  bases.  Here 
the  problem  is  given  a  class  F  of  target  functions  and  a  collection  B  of  bases,  to  find  the 
best  basis  for  /  to  be  used  in  conjunction  with  n-term  approximation.  The  remarkable  work 
of  Donoho  shows  that  in  a  Hilbert  space  setting  with  the  library  of  orthonormal  bases  it  is 
often  possible  to  determine  the  best  basis  for  the  class  F  a  priori.  In  [DPT],  we  generalize 
Donoho’s  work  to  more  general  Lp  metrics  and  show  that  the  competition  for  best  bases  can 
be  enlarged  to  the  class  of  all  unconditional  bases  which  are  democratic. 


Theoretical  and  Numericai  Tunis 

An  important  consequence  of  our  work  in  [CDPX]  is  the  proof  that  a  function  in  BV  has 
wavelet  coefficients  in  weak  l\.  This  result  has  had  considerable  resonance  in  PDEs.  Yves 


Meyer  has  shown  that  our  results  give  new  embedding  inequalities  (Poincare,  Gagliardo- 
Nirenberg)  for  Besov  spaces  which  are  important  in  PDEs.  He  then  conjectured  other  im¬ 
provements  which  could  not  be  derived  from  the  weak  £i  theorems  for  the  wavelet  coefficients 
of  BV  functions. 

In  a  series  of  papers  (the  first  two  are  [CDD],  [CDDl]),  we  are  developing  adaptive 
wavelet  based  algorithms  for  solving  operators  equations.  These  papers  are  the  first  to 
derive  adaptive  PDE  solvers  whose  rates  of  convergence  can  be  determined  a  priori  -  in  fact, 
we  produce  an  algorithm  whose  error  bounds  are  shown  to  be  optimal  in  terms  of  its  rate  of 
approximation  of  the  unknown  solution  u  to  the  operator  equations. 
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